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Abstract — We propose to send a Gaussian source over an 
average-power limited additive white Gaussian noise channel by 
transmitting a linear combination of the source sequence and 
the result of its quantization using a high dimensional Gaussian 
vector quantizer. We show that, irrespective of the rate of the 
vector quantizer (assumed to be fixed and smaller than the 
channel's capacity), this transmission scheme is asymptotically 
optimal (as the quantizer's dimension tends to infinity) under 
the mean squared-error fidelity criterion. This generalizes the 
classical result of Goblick about the optimality of scaled uncoded 
transmission, which corresponds to choosing the rate of the vector 
quantizer as zero, and the classical source-channel separation 
approach, which corresponds to choosing the rate of the vector 
quantizer arbitrarily close to the capacity of the channel. 

I. Introduction 

The minimal distortion with which a memoryless source 
can be communicated over a memoryless noisy channel is 
given by the evaluation at channel capacity of the distortion 
vs. rate function corresponding to the source law and the 
fidelity criterion [1, Thm. 9.6.3]. For a memoryless Gaussian 
source and an average-power limited additive white Gaussian 
noise (AWGN) channel two classical schemes are known to 
achieve this minimum distortion: the source-channel separa- 
tion approach [2] and Goblick's "uncoded" scheme [3]. (See 
also [7], [8], and [9].) Here we shall show that these two 
schemes can be viewed as the endpoints of a continuum of 
optimal transmission schemes. In the proposed transmission 
schemes the transmitted waveform is a linear combination of 
the source sequence and of the result of its quantization using 
a Gaussian vector quantizer. The source-channel separation 
approach corresponds to having the rate of the vector quantizer 
be arbitrarily close to channel capacity, and Goblick's uncoded 
scheme corresponds to having the rate of the vector quantizer 
be zero. 

We point out that in contrast to other work on hybrid digital- 
analog joint source-channel coding, e.g. [4], [5] and [6], we 
do not aim for issues like "robust" communication, but merely 
mean to point out a generalization of two well-known optimal 
schemes. Also, it should be emphasized that our transmission 
schemes do not increase bandwidth. This should be contrasted 
with the problem addressed by Shamai, Verdu and Zamir [4] 
where a memoryless source is to be transmitted to a receiver 
via two independent channels where the transmission over one 
of the independent channels is required to be uncoded. 



II. Some Definitions 

To state our contribution more precisely we need some 
definitions. The additive white Gaussian noise channel is a 
channel whose time-fc output takes value in the set of reals 
K and is given by 



Y k = x k + Z k 



(1) 



where x k G K denotes the time-fc channel input and where 
the random variables {Zk} are IID, zero-mean, variance- N, 
Gaussian random variables. We say that the length-n sequence 
of inputs xi, . . . , x n satisfies the average power constraint if 



n 



xj < P. 



(2) 



The capacity of the additive white Gaussian noise channel 
under the above average power constraint is given by 



C 



1 



log 1 



P 

N 



(3) 



(We assume throughout that N is strictly larger than zero.) 

The memoryless zero-mean variance-tr 2 source is a source 
that emits the sequence {Si} of IID zero-mean variance-a 2 
Gaussian random variables. The variance a 2 is assumed to be 
strictly larger than zero. The distortion vs. rate function D(R) 
corresponding to this source and to the single-letter squared- 
error fidelity measure d(s, s) = (s — s) 2 is given by 



D(R) 



2 n -2R 

a Z 



(4) 



The evaluation of the above distortion vs. rate function at 
the capacity of the additive Gaussian noise channel is given 
by 



D* 
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\R=±log(l+P/N) 
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(5) 



A blocklength-n transmission scheme is a pair of mappings 
f n ,4>n '■ R" —> K" with the understanding that when the 
source emits the sequence s £ R" the sequence 

/„(s) = (.ti(s), . . .,x„(s)) 



is fed to the channel. We require that the transmitted sequence 
satisfy the average power constraint 

E[||/„(S)|| 2 ] <n-P 



i.e., 



1£e[^(s)]<p. 



(6) 



The channel then produces the output sequence Y whose 
i-th component Yi is given by Yi — Xj(S) + Zj, i = 
1, . . . , n. This output sequence is then mapped by to the 
reconstruction sequence S: 

S - 0„(Y) 
4 (5 1 (Y),...,5„(Y)). 

The distortion associated with (f n ,(f> n ) is given by 



d(/ n) ^ n ) = i^E[(5i-5i(Y))' 



(7) 



where 5; and denote the i-th component of S and S 
respectively. 

A sequence of schemes {/ n , <fi n } indexed by the blocklength 
n is said to be asymptotically optimal for the transmission 
of a Gaussian source over the additive white Gaussian noise 
channel under the mean squared-error fidelity criterion if 
it results in the transmitted sequence satisfying the average 
power constraint i.e., 



E[||/„(S)f] <nP 



and if 



lim d(f n ,(f> n 



D*. 



(8) 



(9) 



In this submission we propose a sequence of asymptoti- 
cally optimal transmission schemes parameterized by the free 
parameter 

(10) 



< p < - log 



which corresponds to the rate of the Gaussian vector quantizer 
that we employ. Thus, to each fixed p as above, we present a 
sequence {/ n ,<^n} of coding schemes (parameterized by the 
blocklength-n) that is asymptotically optimal. 

III. The Proposed Scheme 

The proposed scheme is conceptually simple, but this sim- 
plicity is masked by some of the epsilons and deltas involved. 
For the sake of clarity and brevity we shall therefore omit 
these epsilons and deltas here. 

At the heart of the scheme is a rate-p Gaussian vector 
quantizer. We denote the quantizer's codebook by C and 
assume that its 2 np codewords are chosen independent of each 
other, each being drawn uniformly over a centered sphere in 
K". The normalized squared-radius of the sphere is roughly 
a 2 — a 2 2~ 2p so that the normalized squared-norm of each of 
the codewords in C is given roughly by 

hufno 2 -^-*' (11) 



where n denotes the blocklength, ||u|| 2 denotes the sum of the 
squares of the components of u, and where a 2 is the source's 
variance. 

Notice that this would be a rate-p optimal vector quantizer 
for this source and that it would yield a quantization error A, 
where 

A re cr 2 2" 2p . (12) 



Also, if we slightly increase p or slightly decrease the radius 
of the sphere on which the codewords of the quantizer lie, we 
could (with very high probability) find a codeword u* e C 
such that s u* would be nearly orthogonal to u*. Such a 
codeword u* would then satisfy 



a 2 - (a 2 - a 2 2- 2 P) 
cj 2 2- 2 p 



(13) 



where the first approximation follows because s u* is nearly 
orthogonal to u* and where the second approximation follows 
by the law of large numbers for ||S|| 2 /n and from our choice 
of the radius of the quantizer's sphere. 

We can now describe the encoding schemes. Observing the 
source sequence s, we choose the codeword u* in the vector 
quantizer's codebook C equiprobably among all codewords 
that have a "typical" angle to s, i.e. equiprobably among all 
ueC satisfying 



(14) 



where (•, •) is the standard inner product in R™. If no such 
u e C exists, the codeword u* is choosen to be the all zero 
sequence 0. By slightly shrinking the quantizer's sphere we 
can guarantee that with very high probability there exists at 
least one ueC satisfying 14l >. and consequently, with help 
of the weak law of large numbers for ||S|| /n, that with very 
high probability 

(s-u*,u*)«0. (15) 

The transmitted sequence x = /„(s) is now given by a linear 
combination of u* and the source sequence s: 



x = fn(s) = as + /3u* 



(16) 



where the coefficients a = a(p) and j3 = (3(p) are judiciously 
chosen as 



a(p) 



2-*p(N + P) - N 



(17) 



(18) 



a 2 2- 2 P 

This choice of a and (3 is dictated by two requirements. The 
first is that x roughly satisfy the power constraint. Indeed, 
writing 

x= (a + /5)u* +a(s-u*) (19) 
we note that by d!5l > we shall have ^||x|| 2 rs P if 
{a + /3) 2 ||u|| 2 /?i + a 2 ||s - u*|| 2 /ti « P 



or, in view of Jilt and dl 31 . if 



showing that 



{a + (3) 2 a 2 (l - 2~ 2p ) + a 2 a 2 2- 2p « P. 



(20) 



The second requirement dictating the choice of a and (3 has 
to do with the decoding and will be described as soon as we 
describe how the source sequence is reconstructed from the 
channel output. 

This reconstruction takes place in two phases. In the first 
phase the decoder makes a guess u 6 C of the transmitted 
codeword u* 6 C. In the second phase the decoder then makes 
an estimate s of the source sequence based on y and u. The 
guess of u* in the first phase is based on the observation 



Y= {a + P)u* + a(s - u* 



(21) 



The decoder treats the scaled quantization noise a(s — u*) as 
Gaussian noise, and thus "sees" a signal ((a+/3)u*) of average 
power (a + /3)er 2 (l — 2~ 2p ) contaminated in additive noise 
(a(s — u*) + Z) of variance a 2 a 2 2~ 2p + N. Using minimum 
angle decoding, i.e. u = argmax ueC (y, u), it can be shown 
after some analysis that the decoder will succeed with high 
probability if [10] 



P < 2 lo S 



1 



(a + f3)a 2 (l-2- 2 P) 

a 2 a 2 2 -2p + N 



(22) 



Replacing this inequality with an (approximate) equality gives 
us the second condition on a, (3, 

In the second phase the reconstructor assumes that the 
first phase was successful in identifying the codeword u*. 
Rearranging terms in ( 12 II we have 



Y - (a + 0)u* 



a 



iz. 

a 



And, since u* and s — u* are nearly orthogonal, a reasonable 
estimator of S is now the linear estimator 

a 2 A 



S = u* 



2 A + iV 



(23) 



and this is, indeed, the reconstructor we propose. Thus, the 
reconstruction function <f> n can be formally defined as 



<My) = u 



y - (a + /3)u 



y 2 A + N 



(24) 



where u = argmax ueC (y, u) and A = a 2 2~ 2p . 

The expected squared error associated to the proposed 
sequence of schemes {f n ,4>n} 



d(f n , 4>n) = -E 
n 



S - S 



(25) 



where the expectation is taken over all S, Z and C, can now 
be analyzed by using 



1 



* 2 A + N 



(TVs - a[3Au* - aAz — (N — a0A)u) , 



in d25i . Writing the expectation as a sum of the individual 
cross-terms (most of which are straightforwardly bounded) and 



E[(S,U*}] > ncr 2 (l - 2- 2R ), 
- [! ' ' • na 2 (l-2- 2R ), 

0. 
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then results in 
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N 
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Of course, the rigorous analysis also requires analyzing the 
effect that the non-existence of a codeword u G C satisfying 
the encoder condition dl4> and the effect that an error in 
identifying u* entail, as well as justifying the approximations 
that we have presented. 

IV. Conclusion 

We have shown that for the transmission of an IID Gaussian 
source over an AWGN channel with average input power 
constraint, the minimal expected squared error distortion can 
be achieved by the superposition of coded and uncoded trans- 
mission, for arbitrary power repartition among the schemes. 
The preserved correlation between the source sequence and the 
transmitted codeword makes the coded and uncoded schemes 
perfectly compatible. 
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